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Gateway 


Directions: 

This  test  measures  your  ability  to  determine  the  position  of  an  airplane  in  flight  from 
reading  instruments  showing  its  compass  heading,  amount  of  climb  or  dive,  and 

degree  of  bank  to  right  or  left. 
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Products 


he  high  costs  associated  witli  test  scores],  medical  qualification,  indicators  of 

pilot  training,  aircraft,  and  avia-  “officershi[V’  [e.g.,  commander’s  ratings  from  an 

tion  accidents  demand  that  every  officer  training  program),  and  prior  flying  ex[Hui- 

eftort  he  made  to  select  the  best  pilot  ence  (e.g.,  hours  flown,  private  pilot’s  certificate), 

training  candidates.  Since  WVVI,  a  laige  Personality  assessment  (e.g.,  psychological  inter¬ 
amount  ot  time,  money,  and  effort  have  view)  is  done  in  some  military  organizations,  hut 

been  spent  bv  both  militarv  and  com-  is  less  common. 

mercial  aviation  to  identify  the  charac-  Selection  into  military  pilot  training  is  a  multi-  |  | 

teristics  needed  to  he  a  good  pilot  and  stage  [process  in  which  decisions  are  made  at  se\^- 

the  means  to  accurately  measure  those  eral  points.  Weeks  and  Zelenski  (1998)  identified 

characteristics.  The  military  has  gone  nine  harriers  to  entrv  into  U.S.  Air  force  pilot  The  Human  Systems  lAC  is  a  United 

even  further,  attempting  to  determine  training,  fkirriers  included  demonstration  of  mini-  States  Department  of  Defense 

whether  a  pilot  would  be  better  suited  mum  educational  achievement,  interest  in  the  mil-  Information  Analysis  Center  adminis- 

to  lly  tighter  or  nontighter  aircraft.  itary,  interest  in  the  Air  force,  officer  qualification,  tered  by  the  Defense  Technical 

Military  pilot  applicants  typically  officer  selection,  desire  to  fly,  flying  training  qual-  Information  Center,  Ft.  Belvoir.  VA. 

have  little  or  no  prior  tlying  e.xperience  ideation,  pilot  training  selection,  and  successful  technically  managed  by  the  Air  Force 

and  may  not  have  had  prior  exposure  to  completion  of  flight  screening.  The  order  of  over-  Research  Laboratory  Human 

the  military.  Commonly  used  selection  coming  these  harriers  varies  across  individuals.  Effectiveness  Directorate.  Wright- 

tactors  include  measures  ot  ability  (e.g.,  For  instance,  some  may  know  at  an  early  age  that  Patterson  Air  Force  Base,  OH,  and 

academic  perlormance,  standardized  they  wish  to  become  a  pilot.  Their  occupational  operated  by  Booz  Allen  Hamilton. 

conttnued  on  next  page  McLean,  VA. 
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choice  then  drives  subsequent  decisions 
regarding  education  and  military  serv¬ 
ice.  Others  choose  a  career  with  the  mil¬ 
itary  as  a  means  to  finance  their  educa¬ 
tion,  and  only  later  decide  to  become  an 
officer  and  pursue  a  career  as  a  pilot. 
Another  example  is  the  timing  and  role 
of  flight  screening  programs.  Some  pilot 
applicants  attend  flight  screening  after 
being  chosen  to  enter  pilot  training. 
Others  attend  flight  screening  programs 
at  an  earlier  stage,  perhaps  prior  to 
completion  of  an  officer-commissioning 
program.  Although  qualification  stan¬ 
dards  and  selection  methods  vary  wide¬ 
ly,  these  barriers  are  representative  of 
many  military  pilot  selection  programs. 

Are  Effective  Pilots 
“Selected”  or  “Trained”? 

In  the  U.S.  military,  the  roles  of  selec¬ 
tion,  training,  and  human  factors  in 
pilot  performance  are  often  treated  as 
independent.  This  is  unfortunate  as 
they  are  interrelated.  Poor  selection  will 
result  in  higher  training  attrition, 
increased  training  costs,  and  a  lower 
level  of  job  performance.  Conversely, 
analyses  of  pilot  tasks  should  be  used  to 
identify  critical  selection  factors. 

Cockpit  design  affects  pilot  perform¬ 
ance  and  training  requirements.  Poor 
pilot-vehicle  interface  (PVI)  designs  will 
increase  pilot  cognitive  demands,  work¬ 
load,  and  errors.  Further,  the  Real-Time 
Information  to  the  Cockpit  (RTIC)  ^  con¬ 
cept  may  increase  pilot  information-pro- 
cessing  requirements  and  workload. 
Poor  PVI  designs  and  RTIC  will  result  in 
increased  selection  (e.g.,  intelligence, 
working  memory)  and  training  require¬ 
ments  (i.e.,  more  training  needed  to 
learn  to  use  a  poor  PVI) . 

Milifaty  Pilot  Selection 
Procedures— Cumulative  Evidence 

The  critical  knowledge,  skills,  abili¬ 
ties,  and  other  characteristics  needed  to 
be  a  successful  pilot  have  changed  as 
aircraft  systems  have  become  more 
complex.  Modern  aircraft  operation  is 
less  dependent  on  stick-and-rudder 
skills,  placing  greater  demands  on  cog¬ 
nitive  ability.  Cumulative  evidence 
points  to  measures  of  general  cognitive 
ability  (g)  as  the  most  important  con¬ 
struct  in  the  prediction  of  pilot  training 
performance  (Ree  &  Carretta,  1996). 


Directions: 

In  this  single-dimensional  tracking  task,  the 
participant  uses  a  control  stick  to  move 
a  cursor  left  or  right  to  hit  the  target  circles  as 
they  scroll  down  the  screen. 

Figure  2.  UK  RAF  Control  of  Velocity  Test. 

Other  constructs,  such  as  flying  job  knowledge, 
psychomotor  ability,  and  personality  have  been 
shown  to  add  to  the  predictiveness  of  g.  This  is 
consistent  with  results  from  mainstream  personnel 
selection  studies  (Schmidt  &  Hunter,  1998)  that 
show  g  is  the  most  useful  predictor  of  training  and 
job  performance  across  many  occupations  and  that 
work  sample,  job  knowledge,  integrity,  and  con¬ 
scientiousness  tests,  and  structured  interviews 
may  increment  the  predictiveness  of  g. 

There  are  several  ways  to  measure  these  con¬ 
structs.  The  most  common  in  military  aviation  are 
multiple  aptitude  paper-and-pencil  tests,  comput¬ 
erized  tests,  and  interviews.  Computer-based  and 
simulator-based  job  sample  tests  are  sometimes 
used,  but  are  less  common. 

Examples  of  Current  Practices 

U.S.  military.  There  has  been  little  innovation  in 
U.S.  military  pilot  selection  procedures  since  the 
early  1990s  when  the  Army,  Navy,  and  Air  Force 
each  introduced  new  pilot  selection  tests.^  At  that 
time,  the  U.S.  Air  Force  implemented  a  computer¬ 
ized  test  known  as  the  Basic  Attributes  Test  (BAT) 
as  an  adjunct  to  operational  selection  procedures. 
BAT  psychomotor,  information  processing,  and 
personality  scores  are  combined  with  the  Air  Force 
Officer  Qualifying  Test  (AFOQT)  Pilot  composite 
and  a  measure  of  prior  flying  experience  to  create 
a  pilot  aptitude  composite  called  the  Pilot 
Candidate  Selection  Method  (PCSM).  The  predic¬ 
tiveness  of  the  AFOQT  for  pilot  training  perform- 
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ance  conies  almost  entirely  from  its  measurement 
of  y  and  ax'iation  iob  knowledge  (Olea  Ree, 
1994J.  In  the  PCSM  equation,  the  validity  of  the 
AM'^QT  is  incremented  by  the  H/VF  psychomotor 
and  personalit\’  scores  and  a  measure  of  flying 
experience  (Carretta  (A  Ree,  1994). 

A  follow-on  program  to  develop  the  next  gener¬ 
ation  of  LI.S.  Air  Force  computerized  a\'iation 
selection  tests  was  discontinued  in  1997  when  the 
Air  Force  Research  Laboratory  was  reorganized 
and  sex'oral  programs,  including  many  manpower 
and  [Personnel  research  efforts,  were  canceled.  LI.S. 
Army  and  LI.S.  Na\x’  jiilot  selection  research  and 
de\'elopment  (Rckl))  efforts  ha\'e  been  stifled  by 
similar  cutbacks.  However,  new  forms  of  the 
AFOQT  continue  to  be  dex'eloped  and  implement¬ 
ed  about  ex'ory  seven  years. 

Non-U. S.  nuliuiry.  That  is  not  to  say  that  pilot 
selection  R(An  is  not  flourishing  elsewhere.  The  LJK 
Royal  Air  Force  (RAF)  has  an  active  aircrew  selec¬ 
tion  Rc9n  program.  Historicalbr  tiie  RAF'  has  relied 
hea\'ily  on  ability  measurement  for  iob  s[iecialties 
such  as  pilot  and  on  measures  of  persouality/char- 
acter  and  biogra[4iical  information  for  overall  offi¬ 
cer  suitabilit\'  (Hailey  (k  Woodhead,  1996).  'Fhe 
RAF  takes  a  “domain-centered”  approach  to  air¬ 
crew  selection.  'Fhe  emphasis  is  on  first  identifying 
the  approinaate  ability  domains  for  a  particular 
occupation  (e.g.,  pilot,  na\ngato]‘,  weapons  direc- 
tor,  air  traffic  conti'oller)  then  choosing  one  or 
more  tests  to  represent  the  critical  tlomains.  As  the 
result  of  task  anabases,  the  RAl-  identified  six  pilot 
ability  domains: 

•  Aitentional  Capacity, 

•  Fsychomotor, 

•  Reasoning  (Numerical), 

•  Reasoning  (Wrbal), 

•  Spatial,  and 

•  Work  Rate. 

RAF  officer  and  aircrew  selection  proccLlures  are 
thorough,  inx'oK'ing  two  phases  that  take  uy  to 
four  days  to  complete.-'’  Phase  1  activities  include 
aptitude  tests,  a  medical  exam,  and  an  interview. 
4\vo  officers  conduct  the  interview,  which  focuses 
on  the  applicant's  achievements,  motivation,  and 
awareness  of  military  and  current  affairs.  Phase  2 
includes  a  groip')  discussion,  indix'idual  and  group 
problem  solving  exercises,  a  fitness  test,  and  a 
final  interxnew. 

Although  the  use  of  multiple  aptitude  tests  is 
common  in  pilot  selection,  others  ha\’e  proposed 
using  simulator-based  tests  to  improve  selection 
procedures.  The  Gei'man  Air  Force  combines  the 
two  approaches  in  a  three-phase  process  (Hansen 
N  Wolf,  2000).  Phase  1,  Militarv  Aptitude  and 
Academic  Fitness,  includes  computer-assisted 
tests  of  intelligence  and  cognitive  abilities,  written 


composition,  oral  presentation,  group 
discussion,  a  physical  fitness  test,  and 
an  interx'iew  by  two  officers  and  a  psy¬ 
chologist.  Phase  2,  Psychological  and 
Medical  Selection,  includes  computer- 
assisted  cognitive,  psychomotor,  and 
personality  tests,  assessment  center 
activities  (leadership  and  organization¬ 
al  skills),  a  flight  physical,  and  an 
inteiA'iew  by  two  psychologists  and  a 
staff  officer.  Interview  content  includes 
personality  develo[unent,  military 
career,  ideas,  values,  and  motivation, 
and  motiwition  to  fly.  Phase  3  is  assess¬ 
ment  in  the  simulator-based  Flight 
Psychological  Selection  (F'PS  80)  sys¬ 
tem.  The  F'PS  80  is  a  low-fidelity  simu¬ 
lator  of  a  single-engine,  propeller-driv¬ 
en  aircraft.  3'he  flight  model  is  based  on 
a  Piaggio  1490.  Phase  3  begins  with 
lectuies  on  aerodynamics,  navigation, 
and  the  FPS  80.  Prior  to  flying  their  first 
“mission"  in  the  FPS  80,  ap[4icants 
must  pass  a  written  test  on  this  materi¬ 
al.  Gress  and  Willkomm  (1996)  demon¬ 
strated  incremental  validity  for  the  FPS 
80  beyond  that  provided  by  the  basic 
psychological  tests.  Though  Gress  and 
Willkomm  were  encouraged  by  the 
incremental  wilidity  of  the  FPS  80,  they 
identified  several  obstacles  to  the  use  of 
simulator-based  tests  including  cost  of 
the  test  system  and  test  administration 
(e.g.,  centralized  testing,  amount  of 
time  needed). 
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For  further  information, 
please  contact: 

Dr.  Thomas  R.  Carretta 
Tel:  (937)  656-7014 

DSN:  986-7014 
E-mail:  thomas.carretta® 
wpafb.af.mil 

Thomas  R.  Carretta,  Ph.D. 
Engineering  Research 
Psychologist 

Crew  Systems  Development 
Branch 

Human  Effectiveness 

Directorate 

Air  Force  Research 

Laboratory 

2210  8th  Street,  Bldg.  146 
Wright-Patterson  AFB,  OH 
45433-7511 


Conclusion 

Cumulative  evidence  has  shown  that 
measures  of  g  have  been  and  will  likely 
continue  to  be  a  mainstay  in  military 
pilot  selection  batteries.  Pilot  job  knowl¬ 
edge  and  psychomotor  ability  have 
shown  incremental  validity  beyond  cog¬ 
nitive  ability.  Results  from  large-scale 
meta-analyses  of  personnel  selection 
(Schmidt  &  Hunter,  1998)  suggest  that 
additional  increments  may  come  from 
work  sample,  job  knowledge,  integrity, 
and  conscientiousness  tests,  and  from 
structured  interviews. 

Paper-and-pencil  multiple  aptitude 
batteries  are  useful  for  making  a  “first 
cut”  as  they  are  inexpensive  to  develop 
and  administer.  Interviews,  computer- 
based  tests,  assessment  center  exercis¬ 
es,  flight  screening,  and  simulators  are 
useful  for  measuring  factors  not  easily 
assessed  by  paper-and-pencil  tests. 

The  methods  used  to  assess  pilot  apti¬ 
tude  are  not  so  important.  The  bottom 
line  for  aviation  psychologists  is  to 
know  what  constructs  are  important, 
then  develop  reliable  selection  methods 
and  employ  sound  methodological  pro¬ 
cedures.  ■ 
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Endnotes 

1.  Military  aircrews  are  increasingly  dependent 
upon  methods  by  which  they  can  effectively 
exploit  new  and  updated  information  from  off- 
board  sources  to  improve  situation/battlefield 
awareness  and  mission  success.  The  RTIC  con¬ 
cept  provides  this  capability  by  allowing  air¬ 
crews  to  receive  accurate,  mission  essential 
information  from  a  variety  of  off-board  sources. 
RTIC  provides  timely  and  reliable  information 
regarding  defensive  and  offensive  air-to-air  and 
surface-to-air  threats,  hostile  force  locations, 
mission  route  and  weather  updates,  and  infor¬ 
mation  on  friendly  forces,  communications, 
support,  and  mission  changes. 

2.  The  U.S.  Army  test  used  for  selection  into  heli¬ 
copter  training  is  called  the  Alternate  Flight 
Aptitude  Selection  Test  (AFAST) .  It  has  seven 
subtests  that  assess  background  characteristics, 
special  aptitudes,  and  personality.  The  subtests 
are  Self-Description,  Background  Information, 
Comprehension,  Complex  Movements, 
Helicopter  Knowledge,  Cyclic  Orientation,  and 
Mechanical  Functions.  The  U.S.  Navy’s 
Aviation  Selection  Test  Battery  (ASTB)  is  used 
to  predict  performance  in  the  U.S.  Navy, 

Marine  Corps,  and  Coast  Guard  pilot  curricu¬ 
lum.  The  six  ASTB  subtests  assess  background 
information,  aptitude,  and  job  knowledge.  The 
ASTB  subtests  are  Math/ Verbal,  Mechanical 
Comprehension,  Spatial  Apperception,  Aviation 
and  Nautical  Information,  Biographical 
Inventory,  and  Aviation  Interest. 

3.  By  comparison,  the  U.S.  Air  Force  AFOQT 
requires  about  four  hours  to  complete  and  the 
BAT  another  two  hours. 
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JC,"  he  Human  Systems  Information  Analysis 
ly  Center  (Human  Systems  lAC)  is  the  gateway 
E'  to  worldwide  sources  of  up-to-date  human 
systems  information  for  designers,  engineers, 
researchers,  and  human  factors  specialists. 

HSIAC’s  primary  objective  is  to  acquire,  analyze, 
and  disseminate  timely  information  about  human 
systems/ergonomics.  The  Human  systems  lAC 
offers  five  levels  of  user  service: 
e  Basic  Inquiry 
s  Search  &  Summary 
Review  &  Analysis 
^  Technical  Area  Task 
Meeting  Administration 

The  Basic  Inquiry  offers  limited  technical  service 
at  no  cost  to  the  user  to  clarify  and  respond  to  a 
specific  inquiry.  Basic  Inquires  can  be  requested  by 
contacting  the  Human  Systems  lAC  Program  Office: 

Phone:  (937)  255-2450 
Fax:  (937)  255-4823 

E-mail:  paul.cunningham2@wpafb.af.mil 

Cost  for  other  services  are  based  on  the  technical 
nature  and  time  involved.  For  information  on  products 
go  to:  http://iac.dtic.mil/hsiac/products/pstoc.html 


Observe 


Noldus  Information  Technology  bv 
Wageningen.The  Netherlands 
Phone:  +31-317-497677^ 

E-mail;  tnfo@noldu5.nl 

Noldus  Information  Technology  GmbH 
Freiburg,  Germany 
Phone:  +49-761-4701600 
E-mail:  info@noldus.de 

Noldus  Information  Technology  Inc. 
Leesburg,  VA,  U.S.A. 

Phone:  +1-703-771-0440 
Toll-free:  1-800-355-9541 
E-mail:  info@noldus.com 

www.noidus.com 


As  a  researcher, you  have  to  spend  your  resources  as 
efficiently  as  possible.  Saving  time  during  the  collection, 
analysis  and  presentation  of  observational  data  can 
mean  a  big  help.  And  that's  exactly  what  The  Observer 
can  do  for  you.  Whether  you  are  observing  live  or  from 
video, The  Observer  offers  you  an  easy  and  accurate  tool 
for  the  study  of  activities,  postures,  movements  or 
human-system  interactions. 


Noldus 


Innovative  tools  for  behavioral  research 


'  fter  the  tragic  events  of  September  11th,  many  groups 
/;  y  and  organizations  contributed  time,  effort,  and 
//  -  resources  to  try  to  repair  the  damage  done  and  to 

prevent  terrorists  from  succeeding  in  the  future.  We  as 
human  systems  professionals  potentially  can  help  in  many 
ways. 

We  have  expertise  in  many  technical  domains:  human 
factors  engineering  (HFE),  health  hazards,  safety  factors, 
personnel  survivability  factors,  manpower,  personnel  and 
training  (MPT),  medical  factors,  and  habitability. 


Unprecedented  opportunities  for  collaboration  between 
HSI  and  many  other  scientific  and  technical  disciplines 
exist  today,  and  those  of  us  who  publish  the  Gateway 
would  be  pleased  to  hear  how  you  think  the  HSI  commu¬ 
nity  has,  or  could,  support  homeland  security. 

Suggested  top-level  categories  include  awareness  and 
identification  of  terrorism,  prevention  of  terrorism,  prepar¬ 
ing  for  disaster,  crisis  response/crisis  management,  and 
military  response/readiness/deployment. 

We  would  like  to  hear  your  ideas  and  will  not  attribute 
anything  you  are  willing  to  share  with  us  without  your 
permission. 
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A  Coruna,  Spain.  April  15-18,  2002 

Human  Factors  and  Medicine  Panei  Symposium 

On  Spatial  Disorientation  in  Military  Vehicles;  Causes,  Consequences,  and  Cures.  Open  to  Partners 
for  Peace  (PfP)  nations.  Tel:  +33  15561  2262,  Fax:  +33  1  5561  2298. 

Minneapolis,  MN,  USA.  April  20-25,  2002 

CHI  2002  Conference  on  Human  Factors  in  Computing  Systems 

Contact:  CHI  2002  Office,  703  Giddings  Avenue,  Suite  U-3,  Annapolis,  MD  21401 ,  USA. 

Tel:  +1-401-263-5382,  Fax:  +1-410-267-0332,  E-mail:  CHI2002-office@acm.org, 

URL;  http://wvi/w.acm.orq/siqchi/chi2002 

Chantilly,  VA,  USA.  April  29-30, 2002 

2""  Annual  DoD  Ergonomics  Working  Group  Conference:  Forging  Ahead— Preventing  Work-Related 
Musculoskeletal  Disorders 

Registration  and  conference  information  can  be  found  on  the  web  site 
URL:  http://chDDm-www.apaea.armv.mil/eraowa/conference/ 

San  Dieoo,  CA,  USA.  April  29  -  May  2, 2002 

A?'"  Meeting  of  the  DoD  Human  Factors  Engineering  Technical  Advisory  Group 

Contact:  Ms.  Sheryl  Cosing,  10822  Crippen  Vale  Court,  Reston,  VA  20194,  USA. 

Tel:  +1-703-925-9791,  Fax:  +1-703-925-9694,  E-mail;  sherylynn@aol.com, 

URL:  http://dtica.dtic.mil/hftaa/meetschl.html 


Montreal,  Canada.  May  5-9, 2002 

Aerospace  Medical  Association  Annual  Scienficic  Meeting 

Queen  Elizabeth  and  Sheraton  Hotels.  Contact  Mr.  Tom  Clark.  Tel:  +1-757-437-1942, 

E-mail:  exhmgr@aol.com,  URL:  http://www.asma.orq/meetinainfo.html 

Nashville,  TN,  USA.  May  9-12, 2002 

Army  Aviation  Association  of  America  Annual  Convention  (Quad-A),. 

Contact:  AAAA,  Westport,  CT,  USA.  Tel:  +1-203-226-8184,  E-mail  aaaa@quad-a.org 

Orlando,  FL,  USA.  May  19-22,  2002 

HE  Annual  Confereuce  2002 

Contact:  Institute  of  Industrial  Engineers,  25  Technology  Park,  Norcross,  GA  30092,  USA. 

Tel:  +1-800-494-0460  or  +1-770-449-0460,  Fax:  +1-770-441-3295, 

URL:  http://1 28.241 .229.4/Dublic/articles/index.cfm?Cat=265 

Boston,  MA,  USA.  May  19-24,  2002 

SID  2002:  Society  for  Information  Display 

Contact:  SID,  do  Palisades  Institute  for  Research  Services,  Inc.,  411  Lafayette  Street,  2nd  Floor, 
New  York,  NY  10003,  USA.  Tel;  +1-212^60-8090,  Fax:  +1-212-460-5460, 

E-mail:  wklein@palisades.org,  URL:  http://www.sid.ora 

Boston,  MA,  USA.  May  29  -  June  1  ^  2002 - 

6”'  International  Conference  on  Cognitive  and  Neural  Systems 

Contact:  Cynthia  Bradford.  E-mail:  cindy@cns.bu.edu,  URL;  http://www.cns.bu.edu/meetinqs/ 


Toronto,  Canada.  June  10-13, 2002 

XVI  International  Annual  Occupational  Ergonomics  &  Safety  Conference 

Contact;  Dr.  Sourin  P.  Dutta,  Conference  Chair,  ISOES  Annual  Conference  2002,  Department  of 
Industrial  and  Manufacturing  Systems  Engineering,  University  of  Windsor,  Windsor,  Ontario, 
N9B3P4  Canada.  Tel:  +1-519-253-3000,  ext.  2608,  Fax:  +1-519-973-7062, 

E-mail:  sdutta@uwindsor.ca  orcaisoes@uwindsor.ca,  URL:  http://www.uwindsor.ca/isoes 

Huntsville,  AL,  USA.  June  11-13, 2002 

Army  T&  E  Days  2002 — Responding  to  Asymmetrical  Warfare:  The  New  Reality  for  Army  Test  and 
Evaluation 

Contact:  Ms.  Sherry  Hilley.  Tel:  +1-256-842-6715,  (DSN  788), 

E-mail:  shilley@rttc.redstone.army.mil,  URL:  http://www.testevaldavs.com 
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Munich,  Germany.  June  18-20,  2002 

Contact;  John  R.  Miller.  SAE.  755  West  Big  Beaver  Road.  Suite  1600.  Troy,  Ml  48084-4096.  USA 
Tel.  +1-248-273-2464.  Fax:  +1-248-273-2494.  E-mail;  jrmiller@sae.org. 

URL:  hitpj/./w\A/w..sae.org/calendar/gvmtgs.htm 


Orlando,  FL,  USA.  July  8-12,  2002 

11  .A  n  n  u  7  ■:  U  PT  C  u ;  H + r  7  a  f ;  e 

Contact:  UFA  Conference  Office.  Prestige  Accommodations.  1518  Brookhollow  Drive.  Suite  23, 
Santa  Ana.  CA  92705.  USA.  Tel:  +1-800-321-6338  or  +1-714-957-9100, 

E-mail:  registration@prestigeacc.com, 

URL:  http://www.righiinterface.com/upatestsite/conf  upa2002.htm 


Elephant  and  Castle,  London,  UK.  September  2-6,  2002 

URL:  http://cise.sbu.ac.uk/hci2002/index.html 

Pisa,  Italy.  September  18-20,  2002 

URL:  http://Qiove.cnuce.cnr.it/mobiiehci02.html 

Jacksonville,  FL,  USA.  September  30  -  October  2,  2002 

URL:  http:/7www.safeassociation.com/2002sy mp p s i urn.  1.htm 

Baltimore,  MO,  USA.  September  30  -  October  4,  2002 

Pittsburgh  Hilton  and  Towers.  Contact:  HFES  Office,  P.O.  Box  1369.  Santa  Monica.  CA 
90406-1369,  USA.  Tel:  +1-310-394-1811,  Fax  +1-310-394-2410,  URL:  http:/,/hfes,ora 


San  Diego,  CA,  USA.  October  7-9,  2002 


Contact;  National  Safety  Council.  1121  Spring  Lake  Drive.  Itasca.  IL  60143-3201.  USA. 
Tel:  +1-630-285-1121.  Fax:  +1-630-285-1315.  URL:  http:/7www.nsc.org/e xpo02\call.htm 

MIT,  Cambridge,  MA,  USA.  October  23-25,  2002 


Contact:  HCI-Aero  2002  Office,  European  Institute  of  Cognitive  Sciences  and  Engineering 
(EURISCO),  4  Avenue  Edouard  Belin.  31400  Toulouse.  France.  Tel:  +33  (0)  5  62  17  38  38 
Fax:  +33  (0)  5  62  17  38  39,  E-mail:  hci-aero2002@onecert.fr 
URL:  http:/,/www-eurisco.onecert.fr/events./hci-aero2002. htm I.' 


Orlando,  FL,  USA.  December  2-5,  2002 

Orange  County  Convention  Center  on  International  Drive. 
URL:  h Up : //www.  i  i t sec .  o rg/ppc .  h.t m 
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Screening  the  Screeners: 

Improving  Airport  Passenger  and 
Baggage  Screening  , 


Joe  W.  McDaniel,  Ph.D.,  CPE 


of  Transportation  (DOT).  The  government  is 
reported  to  be  worried  about  finding  enough  qual¬ 
ified  people  to  fill  the  40,000  openings  for  screen- 
er  positions.  Applicants  for  the  new  posts  must  be 
U.S.  citizens,  speak  and  write  English  proficiently, 
have  40  hours  of  training  (up  from  the  current  12 
hours)  and  possess  a  high  school  diploma  or  have 
one  year  of  any  type  of  work  experience  that 
demonstrates  the  applicant’s  ability  to  perform  the 
work  of  the  position.  The  TSA  is  developing  a  fed¬ 
eral  aptitude  test  that  is  supposed  to  measure  apti¬ 
tude  necessary  to  conduct  screening;  ability  to  deal 
effectively  with  the  public  and  English  proficiency. 
This  is  one  area  where  the  human  systems  com¬ 
munity  may  be  able  to  assist. 

A  25  Sep  2001  General  Accounting  Office  report 
(GAO-01-1171T)  said: 


The  devastating  terrorist  attacks 
beginning  on  11  Sep  2001  have 
changed  the  character  of  security 
at  airports.  Unfortunately,  human  error 
continues  to  cause  high-visibility  fail¬ 
ures  in  the  passenger  and  baggage 
screening  system.  The  human  systems 
integration  (HSl)  community  would  like 
to  contribute  to  homeland  defense,  and 
problems  related  to  human  error,  man¬ 
power,  personnel,  and  training  are  all 
areas  in  the  HSl  domain. 

Despite  the  critical  emphasis  recently 
placed  on  security,  there  have  been 
some  startling  failures,  such  as  the  3 
Nov  2001  incident  when  a  man  with  a 
carry-on  bag  full  of  weapons  was 
cleared  through  the  Chicago  airport 
security.  Although  the  airport  screening 
equipment  was  operating  normally,  the 
failure  was  the  result  of  human  error. 

On  19  Feb  2002  a  screener  fell  asleep 
at  the  Louisville  airport  causing  15 
flights  to  be  delayed  and  about  1,000 
passengers  to  undergo  rescreening. 
What  is  the  problem  here?  Selection? 
Sleep  deprivation?  Rotating  shifts? 
TVaining?  Human  factors  research  has  a 
wealth  of  scientific  data  on  circadian 
rhythms,  work/rest  schedules,  and  vigi¬ 
lance.  More  important,  human  factors 
tools  and  techniques  have  proven  useful 
in  reducing  human  error  in  critical  jobs. 

Everyone  has  an  opinion  on  the  sub¬ 
ject  of  airport  screening.  Some  believe 
that  airport  screeners  should  be  retirees 
because  they  have  a  better  work  ethic, 
emotional  control,  and  a  fondness  for 
routine.  However,  others  believe  that 
retired  people  have  poorer  vision  and 
are  more  likely  to  fall  asleep. 

When  the  federal  government 
assumes  control  of  airport  security,  it 
will  not  be  under  the  FAA,  but  the 
newly  formed  Transportation  Security 
Administration  (TSA)  of  the  Department 


Turnover  exceeded  over  100  percent  a  year  at  most 
large  airports,  leaving  few  skilled  and  experienced 
screeners,  primarily  because  of  the  low  wages,  lim¬ 
ited  benefits,  and  repetitive,  monotonous  nature  of 
their  work.  Additionaliy,  too  tittle  attention  has  been 
given  to  factors  such  as  the  sufficiency  of  the  train¬ 
ing  given  to  screeners.  Two  conditions— rapid 
screener  turnover  and  inadequate  attention  to  human 
factors— are  beiieved  to  be  important  causes.  From 
May  1998  through  April  1999,  screener  turnover 
averaged  126  percent  at  the  nation’s  19  largest  air¬ 
ports;  5  of  these  airports  reported  turnover  of  200 
percent  or  more,  and  1  reported  turnover  of  41 6  per¬ 
cent  At  one  airport  we  visited,  of  the  993  screeners 
trained  at  that  airport  over  about  a  1-year  period, 
only  142,  or  14  percent  were  still  employed  at  the 
end  of  that  year.  Such  rapid  turnover  can  seriously 
limit  the  level  of  experience  among  screeners  oper¬ 
ating  a  checkpoint  Both  FAA  and  the  aviation  indus¬ 
try  attribute  the  rapid  turnover  to  the  low  wages  and 
minimal  benefits  screeners  receive,  along  with  the 
daily  stress  of  the  job.  Generally,  screeners  are  paid 
at  or  near  the  minimum  wage. 


The  solution  will  require  some  time  and  compe¬ 
tent  researchers  to  systematically  evaluate  the  spe¬ 
cific  job  requirements  and  identify  quantifiable 
characteristics  and  abilities  of  potential  screeners. 
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Working  against  a  systematic  approach  to  soK'ing 
this  problem  is  the  urgency  of  Ihring  a  new  work¬ 
force.  On  the  other  hand,  the  high  turnove]'  rate 
allows  tuning  the  process  for  future  generations  of 
screencrs. 

When  the  military  brings  in  a  new  recruit,  the 
applicant’s  physical  qualifications,  aptitude  and 
moral  standards  are  tested.  To  do  this  testing,  the 
military  has  65  Military  Entrance  Processing 
Stations  fMEPS)  in  42  states  (including  Alaska  and 
Hawaii]  and  Puerto  Rico,  most  of  which  are  locat¬ 
ed  in  or  near  major  cities,  and  a  short  distance 
from  the  major  airports.  This  is  not  to  say  the  TSA 
will  want  help  from  the  MEPS,  but  the  MEPS 
might  serve  as  a  model  of  an  effective  system. 

Every  job  in  the  military  has  tailored  require¬ 
ments  specific  for  the  needs  of  that  particular  job, 
including  vision,  hearing,  strength,  and  mobility. 
Many  military  jobs  require  clean  medical,  psycho¬ 
logical,  drug,  and  criminal  history.  I’his  is  similar 
to  the  requirements  for  airport  screeners.  Over  se\'- 
eral  decades,  the  MEPS  have  developed  effectix'c 
screening  technology  available  for  all  these  factors. 
Furthermore,  the  military  has  specialists  that  peri¬ 
odically  survey  and  update  job  requirements,  per¬ 
forming  task  analyses,  surveys,  job  inventories. 
The  military  has  specialists  for  developing  and  val¬ 
idating  performance-based  selection  tests. 

After  entering  the  service,  recruits  are  sent  to  a 
technical  school  that  prepares  them  for  the  new 
job.  The  instruction  material  is  based  on  analyses 
of  actual  job  requirements.  The  military  has  spe¬ 
cialists  that  translate  job  requirements  into  training 
requirements  and  develop  the  curricula,  'lb  be  pro¬ 
moted,  military  members  are  tested  on  the  techni¬ 
cal  requirements  for  the  job,  but  they  are  also  test¬ 
ed  for  leadership  skills.  In  summary,  the  militarv 
has  a  job-specific  selection,  training,  and  promo¬ 
tion  infrastructure  that  works  extremely  well. 
Additionally,  the  military  has  periodic  physical  fit¬ 
ness  tests  to  maintain  a  healthy,  fit  force  (these 
were  described  in  the  last  special  issue  of  the 
Ciciteivay  Vol.  XII:  No.  4,  2001).  In  the  human  sys¬ 
tems  domain,  these  technologies  are  referred  to  as 
MPT  (manpower,  personnel,  and  training). 

Proper  selection  and  training  is  one  side  of  the 
human-machine  interface.  'I’he  other  side  is  the 
design  of  the  workplace  itself,  specifically,  the 
operator’s  interface  to  the  “machine.”  Assuming 
an  airport  x-ray  machine  has  the  ability  to  show 
the  operator  a  picture  of  sufficient  resolution  to 
identify  a  hazardous  object  inside  luggage,  the 
effectiveness  of  the  system  design  depends  on  fac¬ 
tors  such  as  the  display’s  resolution,  size,  viewing 
distance,  contrast,  color,  location,  ambient  light¬ 
ing,  and  the  enviroiiment  of  operation. 

Airports  have  a  great  variation  in  the  location 
and  orientation  of  x-ray  displays.  Some  displays 


are  located  so  they  require  the  operator 
to  lean  forward  and  look  down,  while 
others  require  short  operators  to  look  up 
at  the  displav.  Operators  are  often  locat¬ 
ed  in  high  traffic  areas  that  might  inter¬ 
fere  with  concentration  and  attention. 
Human  factors  engineers  have  design 
guidelines  for  display  workstations  and 
information  regarding  how  long  some¬ 
one  should  screen  before  attention 
wanes. 

Human  factors  engineers  routinely 
address  all  these  issues.  Sometimes  a 
fresh  approach  is  needed.  We  need  to 
ask,  how  should  an  x-ray  operator’s 
workstation  be  designed  to  maximize 
operator  effectiveness  in  detecting  haz¬ 
ardous  objects  inside  luggage?  However, 
when  technology  is  not  designed  with 
the  human  operators  in  mind,  or  if  the 
human  operators  are  selected  without 
the  aptitudes  to  operate  the  technology, 
errors  will  be  induced  that  negate  the 
effectiveness  of  the  technology. 

Human  error  will  always  be  part  of  a 
system  that  uses  humans  for  work. 
Human  factors  engineers  have  learned 
techniques  to  minimize  that  error,  and 
to  use  safeguards  that  minimize  the 
consequences  of  human  error.  In  recog¬ 
nizing  the  human  component  of  all  sys¬ 
tems,  we  are  able  to  develop  human 
interfaces  that  do  not  induce  human 
error,  while  providing  feedback  to  make 
immediate  errors  cons[4cuous  and  pro¬ 
vide  an  effective  means  of  correcting 
small  errors  before  the  system  fails. 


For  further  information, 
please  contact: 

Dr.  Joe  McDaniel 

Tel:  (937)  255-2558 

DSN:  986-2558 

E-inail:  joe.mcdaniel@ 
wpafb.af.inil 

Joe  W.  McDaniel,  Ph.D., 
CPE 

Principal  Industrial 
Engineer 

Crew  Systems  Development 
Branch 

Human  Effectiveness 

Directorate 

Air  Force  Research 

Laboratory 

2210  8th  Street,  Bldg.  146 
Wright-Patterson  AFB,  OH 
45433-7511 


If  your  address  label  does  NOT  include  a  complete  street  address, 
P.O.  Box,  or  7dP  code,  please  provide  us  with  this  information.  We  are 
trying  to  comply  with  the  regulations  of  the  U.S.  Postal  Service. 
Without  this  information  we  cannot  guarantee  your  continued  receipt 
of  the  Human  Systems  lAC  GATEWAY.  Please  E-mail  changes  to 
roseann.venls@wpafb.af.mil  or  mail  changes  to: 

Human  Systems  lAC  GATEW^AY 
AERE/HEC/HSIAC  Bldg  196 
2261  Monahan  Way 
WPAFB,  OH  45433-7022 
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Train  the  Way 
We  Fight? 


Major  Todd  Heinie 


For  further  information, 
please  contact: 

Major  Todd  Heinie 
Tel:  (937)  656-7011 

DSN:  986-7011 
E-mail:  todd.heinle 

@wpafb.af.mil. 

Major  Todd  Heinie,  is  the 
Program  Manager  of  AFRL’s 
Spatial  Disorientation  Counter¬ 
measures  group.  Additional 
information  regarding  SD  can 
be  found  at  http://www. 
snatinldMjpafb.af.nul 


For  years  now,  operations  person¬ 
nel  have  said  that  we  need  to  train 
the  way  we  intend  to  fight. 
Consequently,  training  scenarios  are  as 
realistic  as  possible,  with  very  little  sim¬ 
ulated  action.  How  else  can  the  student 
recognize  the  flow?  Certainly,  air  traffic 
controllers  train  with  the  maximum 
number  of  aircraft  in  the  traffic  pattern. 
How  else  can  they  develop  the  skills  to 
manage  real  situations?  Without  a 
doubt,  pilots  discuss  the  intricacies  of 
landing  in  a  crosswind,  but  they  also 
actually  fly  approaches  in  crosswinds  so 
they  can  recognize  the  conditions.  The 
absolute  best  way  to  learn  to  parallel 
park  is  to  do  it  with  the  guidance  and 
assistance  of  a  competent  instructor. 

If  practical,  hands-on  learning  is  so 
well  accepted  in  most  every  instruction¬ 
al  setting,  why  then  do  we  teach  new 
aircrew  members  about  spatial  disorien¬ 
tation  (SD)  only  by  talking  to  them  for 
an  hour,  maybe  two,  and  then  demon¬ 
strating  SD  to  one  or  two  of  them  in  a 
Barany  chair?  Why  not  actually  train 
inexperienced  aircrew  to  recognize  the 
situations  that  lead  to  SD,  and  the 
symptoms  of  having  it,  in  a  realistic 
environment? 

SD  has  been  broken  up  into  three 
types:  Type  I  (unrecognized).  Type  II 
(recognized)  and  Type  III  (incapacitat¬ 
ing)  .  Historically,  70  to  80  percent  of  air¬ 
craft  mishaps  that  are  SD-related  are 
Type  I.  Type  II  accounts  for  approxi¬ 
mately  three  percent,  and  Type  III  SD  is 
statistically  insignificant.  The  mishaps 
in  the  remaining  17-27  percent  cannot 
be  classified  into  one  of  the  three  types. 

Put  another  way,  70  to  80  percent  of 
the  time  an  SD  mishap  occurs,  the  air¬ 
crew  member  is  unaware  that  there  is  a 


problem.  Or  to  put  it  into  simpler  terms,  they  are 
“unaware  and  unafraid”  before  tragedy  strikes. 
The  essential  point  is  recognition  of  the  SD  symp¬ 
toms.  How  do  you  fix  a  problem  if  you  do  not 
know  you  have  a  problem?  And  how  do  you  know 
you  have  SD  if  you  have  never  experienced  the 
actual  conditions? 

The  Air  Force  Research  Laboratory’s  (AFRL’s)  SD 
Countermeasures  program  is  currently  building  SD 
flight  profiles  in  collaboration  with  the  U.S.  Army, 
Royal  Air  Force,  Air  National  Guard,  and  the  Navy 
Test  Pilot  School.  The  goal  is  to  produce  profiles 
useable  either  in  the  air  or  in  an  aircraft  simulator 
that  will  reproduce  the  flight  situations  when  SD  is 
most  likely  to  occur.  Instructors  can  then  either  fly 
the  entire  SD  profile,  or  better  yet,  insert  specific 
maneuvers  into  existing  training  missions  and 
allow  the  students  to  recognize  how  SD  can  occur 
during  routine  operations. 

By  exposing  aircrew  to  the  environment  and 
then  the  actual  SD  illusion  in  a  controlled  situa¬ 
tion,  the  aircrew  will  be  more  experienced  about 
the  conditions  leading  to  SD,  and  ultimately 
trained  to  overcome  the  event  when  encountered. 
In  this  way,  we  plan  on  reducing  that  70-80  per¬ 
cent  of  unrecognized  SD  mishaps. 

The  first  step  is  recognition.  SD  is  most  likely  to 
occur  when  a  pilot  is  new  to  an  aircraft.  It  has 
often  been  stated  that  SD  can  happen  at  any  expe¬ 
rience  level,  at  any  time,  as  is  shown  in  Figure  1  by 
the  breakout  of  total  hours  of  the  crewmembers 
involved  in  Class  A  mishaps  involving  SD  from 
1990  to  1999.  Seventy-two  percent  of  these 
mishaps  occurred  to  crewmembers  having  greater 
than  1,000  total  flight  hours.  However,  this  does 
not  mean  that  more  experienced  pilots  experience 
SD  more  often.  If  the  data  from  that  same  time 
period  is  broken  down  into  hours  in  type  of  air¬ 
craft,  approximately  75  percent  of  these  SD  related 
mishaps  happened  to  crewmembers  having  less 
than  1,000  hours  in  that  particular  type  of  aircraft. 
In  other  words,  when  changing  from  one  aircraft 
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includes  all  Class  A  SD  nnishaps  above  1000  hours,  and 
as  such,  is  not  a  500  hour  increment. 


type  to  another,  an  experienced  pilot  to  some 
degree  reverts  to  beginner  status. 

Using  this  different  outlook,  the  SO 
Countermeasures  program  is  focusing  on  develop¬ 
ing  training  profiles,  primarily  for  the  undergradu¬ 
ate  (LIFT)  level,  but  with  additional  follow-on 
training  at  the  aircraft-specific  Idying  draining 
Units  (I'dHs).  The  objective  is  to  improve  effec¬ 
tiveness  with  early  intervention— when  a  pilot  is 
first  starting  out  in  a  new  aircraft.  That  way  they 
can  learn  to  effectively  fight  killer  Sh)  by  training  to 
do  so  at  the  outset.  Wish  us  luck,  because  we 
expect  all  pilots  to  benefit  from  this  SD  training!  • 


email? 

Would  you  like  to  receive  your  copy  of 
GATEWAY  by  E-mail?  If  so,  please  E-mail  your 
address  to  roseann.venis@wpafb.af.mil. 


products 


If  you  have  any  questions  concerning  this  product  list, 
please  access  our  web  page  http://iac.dtic.mil/hsiac  or  contact 
Lisa  McIntosh  at:  Tel:  (937)  255-4842,  DSN:  785-4842, 

Fax:  (937)  255-4823. 


Product  Unit  Price 

50  Years  of  Human  Engineering  Book 

N/C 

50  Years  of  Human  Engineering  CD 

$20.00 

Anthropometric  Data  Analysis  Sets  (ADA) 

$100.00 

Application  of  Human  Performance  Models  to  System  Design 

$60,00 

Biological  Psychology  Special  Issue 

$25.00 

CASHE:  PVS  Software  for  MAC  Computers 

$395,00 

Colloquium  Videotapes 

$25.00 

Color  in  Electronic  Displays 

$45,00 

Electronic  Imaging  Proceedings 

N/C 

Engineering  Data  Compendium  including  User’s  Guide 

$295.00 

Engineering  Data  Compendium  User’s  Guide  ONLY 

$65.00 

HSIAC  Gateway  Newsletter 

N/C 

Human  Factors  Definitions 

N/C 

NASA  TLX  Paper  &  Pencil  Version 

$20.00 

NASA  TLX  Computer  Version  (DOS  Version) 

$20.00 

Directions  in  Performance  Assessment 

$25.00 

Perception  &  Control  of  Self  Motion 

$29.95 

SOAR:  Analysts  Techniques  for  Human  -  Machine  System  Design 

$45.00 

SOAR:  Behind  Human  Error 

$39.00 

SOAR:  Computational  Models  of  Human  Performance 

$39.00 

SOAR:  Human  Factors  Engineering  in  System  Design 

$35.00 

SOAR:  Improving  Function  Allocation 

$39.00 

SOAR:  Naturalistic  Decision  Making 

$35.00 

SOAR:  The  Process  of  Physical  Fitness  Standards  Development 

$45.00 

SOAR:  Situational  Awareness  in  the  Tactical  Air  Environment 

$45,00 

SOAR:  Strategic  Workload 

$35.00 

SOAR:  The  Book  of  HUD 

$35.00 

SWAT  (DOS  Version) 

$50.00 
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PROGRAM  OFFICE 
AFRiyHEC/HSIAC  BLDG  196 
2261  MONAHAN  WAY 
WRIGHT-PAHERSON  AFB  OH  45433-7022 


DEPARTMENT  OF  THE  AIR  FORCE 


http://iac.dtic.mil/hsiac 

(937)  255^842  Telephone 
(937)  785^842  DSN 
(937)  255^823  Facsimile 
(937)  255-2558  Gov.  Tech  Manager 

Thomas  Metzler,  Director 

Dr.  Michael  FIneberg,  Chief  Scientist 

Dr.  Joe  McDaniel,  Gov.  Technical  Manager 

Tanya  Ellifritt,  Assoc.  Gov.  Technical  Manager 

Dr.  Kenneth  R.  Boff,  Gov.  Technical  Director 

Human  Systems  lAC  GATEWAY  is  pub¬ 
lished  and  distributed  free  of  charge  by  the 
Human  Systems  Information  Analysis  Center. 

RoseAnn  Venis,  Editor 

Ahnie  Senft,  Art  Director  &  Graphic  Artist 


OFFICIAL  BUSINESS 


ISCAN  is  the  world's  leading  producer  of  video  based  eye  move¬ 
ment  monitoring  systems.  Since  1980,  our  broad  range  of  prod¬ 
ucts  has  set  the  pace  for  performance  and  usability  in  wide  rang¬ 
ing  research,  military  and  medical  applications.  We  can  provide 
off-the-shelf  or  customized  solutions  to  suit  virtually  any  human 
factors  application. 


Products  &  Features  Include: 

*  Non-invasive,  high  resolution,  real-time 
measurement  of  eye  position,  pupil  size  and 
subject’s  point  of  gaze. 

*  Complete  Eye  and  Head  Tracking  Laboratories,  with  optional  Benchtop, 
High  Speed  (up  to  240Hz)  and  High  Resolution  versions  available. 

*  Integrated  Eye/Head  Tracking  in  VR  Displays. 

*  Ultra  Lightweight  Head  Mounted  Eye  and  Scene  Imaging  Systems. 

*  Specialized  Remote  Mounted  Eye  Imaging  Systems  for  Long  or  Short 
Range  Applications. 

*  Advanced  PCI  Bus  Eye  Tracking  Electronics. 

*  Complete  Data  Acquisition  Hardware  and  Analysis  Software  for  Determi¬ 
nation  of  Subject's  Visual  Performance. 


